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Abstract 

The test statistics of two powerful tests for normality ( Lin fc Mudholkar , 198d; 



Mudholkar et al. . 20021) are estimators of the correlation coefficient between certain 



sample moments. We derive new versions of the test statistics that are functions of 
the sample skewness and sample kurtosis. This sheds some light on the nature of 
these tests and leads to easier computations. 



1 Introduction 

The assumption of normality is the basis of many of the most common statistical meth- 
ods. Tests for normal i ty, use d to assess the normality assumption, is therefore a widely 
studied field. iThodd faooi ) provides an overview Some popular tests for normality 
are based on the sample skewness and sample kurtosis, described in Section [2.21 below. 
Others use characterizations of the normal distribution. 

One such well-known characterization is that the sample mean X and sample variance 
S 2 are independent if and only if the underlying population is nor mal. Similarly, X an d 
n^ 1 Y17=l(Xi ~ X) 3 are independent if and only if X is normal; see Kagan et al. ( 19731 ). 
Se ctions 4.2 and 4.7. 

Lin fc Mudholkail ()l980h proposed a test based on the independence of X and S . 



They noted that it is difficult to test the independence of X and S 2 but that the correla- 
tion coefficient between the two is possible to estimate. They used a jackknife procedure 
to estimate p(X,S 2 ), and used this for a test for normality again st asymmetric alter - 
natives. The test has b een modified, generalized and dis cuss ed in iBrown et al. (2004), 
Mudholkar et alJ (|l992h and I Wilding Mudholkar] (|2007T ). In lMudholkar et alJ (|2002T ) a 
test based on the independence of X and rC 1 ^™ =1 (^Q — X) 3 was proposed, constructed 
using the same jackknife procedure. The authors named the tests the Z2 test and Z3 
test. 

In this paper we show that it is possible to replace the jackknife estimators used by 
Lin and Mudholkar and Mudholkar et al. by estimators that are smooth functions of 
the sample skewness and sample kurtosis. In Section 2 we describe the Z2 and Z3 tests 
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and derive the new estimators. In Section 3 we present some simulation results that 
indicate that the tests have very good power properties. Throughout the text we use 
the notation fif, = E(X — fi) k to denote central moments. 



2 The Z tests and correlation coefficients 

2.1 The Z 2 and Z 3 tests 

Lin and Mudholkar used the n jackknife replications (X-i, where 



n .. _ 

to study the dependence between X and S 2 . They applied the cube-root transformation 
Yi = (S^j) 1 / 3 and concluded that the sample correlation coefficient r(X-i,Yi) equals the 
sample correlation coefficient 



'Eti(A',-x)2E?,i«-i') 2 

Finally, they used Fisher's z-transform to obtain the test statistic 

%2 = 7T log 



2 ° V 1 - r 2 

and used this for their test for normality. The test is sensitive to departures from 
normality in the form of skewness. If the sign of the skewness of the alternative is 
known, a one-tailed test can be used. If it is unknown, a two-tailed test is used. The 
lat ter will be refered to as the l^l test. 



Mudholkar et al.1 ()2002l ) used the same jackknife approach to construct another test 



for normality. This time they considered the mean X and the third central sample 
moment fa = n^ 1 Y27=l(X{ — X) 3 . Letting 



they used the sample correlation coefficient 



r 3 = r(X i ,Y i )^- 



Ei=i(Xi - xf Er=i(^' - Y ) 2 

in the same manner as in the above test, obtaining the test statistic 

Zs = - log 



2 °Vl-r 3 - 

The simulation results in iMudholkar et alJ (|2002h indicate that both tests have high 
power against some interesting alternatives. 
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2.2 Explicit expressions 

Next, we derive explicit expressions for the correlation coefficients p(X, S 2 ) and p(X, /I3), 
which enables us to estimate the correlation coefficients using sample moments. The 
estimators considered in the correlations will be the unbiased estimators S 2 and £13 = 

{n-l)(n-2) YJi=l(Xi - X) 3 . 

The formulae obtained are somewhat easier to express using standardized cumulants. 
Let xi, X2, . . . denote the cumulants of X. The feth standardized cumulant of X is ■ 

We are particularly interested in 

x 3 "3 x 4 ^4 x 6 pq 2 

7 is the skewness of X and k is the (excess) kurtosis of X. All cumulants are for 
the normal distribution. 

Lemma 1. Suppose that X±, . . . ,X n are independent and identically distributed random 
variables. Denote their mean p, variance a 2 , skewness 7 and kurtosis k. Let X = 
I Eti Xi, S 2 = ^ Zti(*i ~ X? ™d p 3 = (n _ 1) " (ra _ 2) U=i(Xi - Xf. Then the 
following results hold. 

(i) If EX 4 < 00 andn > 2, 

P2 = P(X, S 2 ) = / 3 ■ = ; 7 = ■ (1) 



3 M n-3 /„ 1 o n-3 



(ii) If EX 6 < 00 andn>3, 

P3 = p(X,p 3 ) = 



P4 — 3(7 



He _ 9 (2n-5) 114 _ (w-10) M§ , (9ra 2 -36n+60) 
^ 13 n-1 (n-1) ^ ~r (n-l)(n-2) 



(2) 



A + 9^ + 7 2 )+(^f^y 
where A is i/ie sixi/i standardized cumulant of X. 
Proof. The proof amounts to calculating the moments involved: 



(i) It is w ell-known that var(X) = a 2 /n and from the results of Section 27.4 of lCramer 
(jl946h it follows that 



n-3 4 



var(5 2 ) = varf -Ar~ V (X; - X) 2 )) = -p A a 

v y \n-ln^ K ' J J n n(n-l) 

i=l v ; 

and that 

n n-1 1 

cov(A , S ) = — 2— p 3 = -p 3 . 

n — 1 n z n 

The result follows from the above moments and the fact that p^ = <t 4 (k + 3). 
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(ii) From Fisher ( 1930l ) we have 



/A v l x6 9(K + 7 6 )a 6 6ncx e 
var(/x 3 ) = - Act 6 + -i L^— + 



n n—1 (n — l)(n — 2) 

Furthermore, 

cov(X, As) = - M)£s) " - /i)M3) = " /i)M3), 

but this expression does not depend on so we can study the case where \i = 
without loss of generality. Then 

cov(X, A3) = 25(X£ 3 ) = (n _u( n -2) E {*k ( E X ' - 3 ^ E + 3 ^ 2 E ^ - ^ 
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V n n L — ' 



(n — l)(n — 2) V n 1 n 



The t hree expectations above are all found in Sections 27.4 and 27.5 of [Cramer 
l|l94d ). Inserting their values, routine calculations give that the above expressions 
reduces to 



cov(A,/x 3 ) = 



n 



Thus 



/^4 — 3ct 

n 



n ^ V n A(T H S=l h (n-l)(n-2) 

ft jU4 — 3d 4 



A + Q-!W/<- + 'V 2N M ^ fAJm. q ( 2 "~5) (n-lO) Mg , (9n 2 -36n+60) 

^ + l« "I" 7 )+ ( n -l)(n-2) a \ ^ ~ 6 ~1^1^ ~ !^=T) ^ + (n-l)(n-2) 

□ 



Remark 1. Kendall fc Stuartl (jl967l ). Section 31.3, present the asymptotic result that 

The following little-known lemma, relating the standardized cumulants to each other, 
tells us what the possible values of (7, k, A) are. This allows us to study p% and ps as 
functions of the standardized cumulants. 

Lemma 2. Let X, X\, X2, ■ ■ ■ be independent and identically distributed random vari- 
ables that satisfy the conditions in Lemma[J[ Then 

(i) 7 2 < k + 2, with equality if and only if X has a two-point distribution. 

(ii) k 2 < A + 9(k + 7 2 ) + 6, with equality if X has a two-point distribution. 
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The inequality in (i) was first shown by Dubkov Malakhov ( 19761 ). The entire state- 



ment was later shown bv iRohatei Sz Szekelvl ()1989j). (ii) follows from expression (13) in 
Dubkov fc Malakhovl (|l976n " when 7 2 < k + 2. It is readily verified that equality holds for 



two-point distributions. We have not found an X distributed on more than two points 
for which equality holds in (ii), and conjecture that k 2 = A + 9(k + r y 2 ) + 6 only if X has 
a two-point distribution. 

Remark 2. Incidentally, Lemma [2] can be used to verify that p2 and p^ are bounded by 



— 1 and 1. Since k + 2 > 7 2 we have \j\/y k + 3 — < \j\/y/n + 2 < 1 and hence 
|/92 1 < 1, as expected. We see that the correlation coefficient never equals ±1. Looking 
at P3 we similarly get \ps\ < 1 since k 2 < A + 9(/t + 7 2 ) + 6. Conversely, the fact that p2 
and P3 must be bounded by — 1 and 1 can be used as a partial proof of Lemma [2j 

2.3 Test statistics 

The moment estimators of the two correlation coefficients are now obtained by replacing 
the moments by their sample counterparts 
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I 

A : - ir )K Kb-' 15. 

The estimators are thus defined as 

Z'o = , (3) 

Z! i = -75 S 5 • (4) 

From the above equations and Lemma [2] it is clear that Z' 2 in fact is nothing but a 
smooth function of the sample skewness and sample kurtosis, relating the size of these 
two quantities. Likewise, Z' 3 is a smooth function of the sample kurtosis, skewness and 
sixth cumulant. 

The estimators are clearly scale and location invariant, i.e. independent of p and 
a, as 7, k and A all share that property. They are therefore suitable as test statistics 
for tests for normality. Furthermore, it follows from the Cramer-Slutsky lemma that 
they are consistent whenever the necessary moments exist. Asymptotic normality can 
be shown as well, but the convergence is slow and we therefore prefer to obtain the null 
distribution using Monte Carlo simulation. 

2.4 Testing 

From Lemma [1] we conclude that p2 is large when the underlying distribution has high 
skewness, and that high kurtosis brings the correlation coefficient closer to 0. When 
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using Z' 2 as test statistic for a normality test, we should thus reject the null hypothesis 
of normality if, when the alternative distribution has positive skewness, Z' 2 is unusually 
large, or if, when the alternative distribution has negative skewness, Z' 2 is negative and 
unusually large. If the sign of the skewness of the alternative is unknown, \Z' 2 \ can be 
studied instead. 

Similarly, the hypothesis of normality should be rejected if Z 3 is far from 0. If the 
sign of the kurtosis of the alternative is known, a one-tailed test should be used. 

Prom the consistency of the estimators © and dU) it is clear that Z 2 test is consistent 
against alternatives with 7 / and that the Z'% test is consistent against alternatives 
with k 7^ 0. 

An R implementation of the test is found in the cornormtest package, available from 
the author. 



3 A simulation power study 
3.1 Study 

To evalute the performance of the tests a simulation power study was performed, where 
the \Z 2 \, Z' 2 and Z' 3 test were compared to the {Z^l, Z2 and Z3 tests, one-tailed ver- 
sions of the sample m oment tests \Jb[ = 7 and 62 = k, the Shapiro- Wilk test W 



(jShapiro fc Wilkl. Il965l ). Vasicek's test K (jVasicekl . [l976h and the Jarque-Bera test LM 



Bera &: Jar quel . 1 19871 ) . The latter test has performed poorly in previous comparisons of 
power, but is nevertheless popular in econometrics. It is of some interest to us since it 
is based on the sample skewness and kurtosis; the test statistic is LM = n^j 2 + ^k 2 ). 

The tests were studied for x 2 , Weibull, lognormal, beta, Student's t, Laplace, logis- 
tic and normal mixture alternatives and were thus compared for both symmetric and 
asymmetric distributions as well as short-tailed and long-tailed ones. The skewness, 
kurtosis and limit correlation coefficients of the alternatives are given in Table [TJ To 
estimate their powers against the various alternative distributions at the significance 
level a = • 05, the tests were applied to 1,000,000 simulated random samples of size 
n = 20 and n = 50 from each distribution. 

It should be noted that the Student's t distributions considered in the study don't 
satisfy the conditions of Lemma [TJ rendering p2 and p% meaningless. This is discussed 
further in the results section below. 

The simulations were carried out in R, using shapiro . test in the stats package for 
the Shapiro-Wilk test and jarque .bera. test in the tseries pack age for the Jarque- 



Bera test. For Vasicek's test the critical values given in IVasiceki (|l976h were used. Critical 



values for \fb[, 62, l^l, -^2> \Z 2 \, Z 2 and Z'% were estimated using 10,000 simulated 
normal samples for each n. 

3.2 Results 

The Z2, Z3, Z 2 and Z'% tests all performed very well in the study. The results are 
presented in Tables [2][3] below. There was little difference between the performance of 
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Table 1: Skewness, kurtosis and correlation coefficients for distributions in the study 



Distribution 


7 


K 


lim n ->oo p 2 


lirrin^oo p 3 


Normal 














x 2 (i) 


2-82 


12 


0-75 


0-46 


Exponential 


2 


6 


0-71 


0-41 


X 2 (4) 


1-41 


3 


0-63 


0-33 


Weib(l/2,1) 


6-62 


84-72 


0-71 


0-36 


Weib(2,l) 


0-63 


0-25 


0-42 


0-07 


LN(<r = 1/4) 


0-78 


1-10 


0-32 


0-21 


LN(cr = 1/2) 


1-75 


5-90 


0-53 


0-33 


Beta(l/2,l/2) 





-1-5 





-0-95 


Uniform 





-1-2 





-0-84 


Beta(2,2) 





-0-86 





-0-59 


Beta(3,3) 





-2/3 





-0-43 


Beta(l,2) 


0-57 


-0-6 


0-48 


-0-34 


Beta(2,3) 


0-29 


-0-64 


0-25 


-0-39 


Cauchy 










t(2) 










t(3) 










t(4) 











t(5) 





6 







t(6) 





3 







Laplace 





3 





0-38 


Logistic 





1-2 





0-25 


lN(0,l)+|N(l,l) 





-0-08 





-0-03 


iN(0,l)+|N(4,l) 





-1-28 





-0-78 


A N(0 ,1) +1 ^ N (4,1) 


1-2 


1-78 


0-62 


0-44 



the Z2 and Z' 2 tests and between the Z3 and Z' 3 tests. The former is interesting, since 
the Z2 test statistic is an estimator of p(X, (S 2 ) 1 ^ 3 ) while Z' 2 is an estimator of p(X, S 2 ). 

Judging from the simulation results, we make the recommendations that follow below. 
Naturally, these are limited to the tests considered in the study. It should however be 
noted that the Shapiro-Wilk, Vasicek, y/b\ and 62 tests have displayed good performance 
compared to other tests for normality in previous power studies. 

For asymmetric alternatives either the Zi or the Z 2 test should be used. They had 
the highest power against most asymmetric alternatives in the study, and power close 
to that of the best test whenever they didn't have the highest power. The one-sided 
tests are particularly powerful, but the two-sided tests are often more powerful than the 
competing tests. 

For symmetric alternatives either the Z3 or the Z' 3 test can be recommended, both for 
platykurtic (re < 0) and leptokurtic (re > 0) distributions. Vasicek's test and the 62 test 
are more powerful against some alternatives and should be considered to be interesting 
alternatives to the Z3 or the Z' 3 tests. It would be of some interest to compare these 
tests in a larger power study. 

As for the Student's t distributions studied, we note that p2 is undefined for the 
distributions with 4 or fewer degrees of freedom and that p% is undefined for all six dis- 
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Table 2: Power of tests for normality against some alternatives, a = • 05, n = 20 



n = 20 


W 


K 


LM 


Vbi 


b 2 


|Z 2 | 


z 2 


z 3 


|Z 2 | 


z 2 


Z's 


x\i) 


0-98 





99 


0-72 


0-95 


0-61 


0-97 


0-98 


0-64 


0-97 


0-98 


0-62 


Exponential 


0-84 





84 


0-48 


0-81 


0-43 


0-82 


0-89 


0-42 


0-82 


0-89 


0-42 


X 2 (4) 


0-53 





45 


0-29 


0-60 


0-27 


0-55 


0-68 


0-26 


0-57 


0-68 


0-26 


Weib(l/2,1) 


1-00 


1 


00 


0-90 


0-99 


0-83 


1-00 


1-00 


0-85 


1-00 


1-00 


0-84 


Weib(2,l) 


0-15 





13 


0-07 


0-23 


0-08 


0-17 


0-27 


0-07 


0-17 


0-27 


0-08 


LN(<t = 1/4) 


019 





12 


0-12 


0-29 


0-14 


0-20 


0-30 


0-13 


0-21 


0-31 


0-13 


LN(cr = 1/2) 


0-52 





40 


0-33 


0-62 


0-33 


0-56 


0-67 


0-31 


0-57 


0-67 


0-32 


Beta(l/2,l/2) 


0-72 





92 


0-00 


0-02 


0-77 


013 


0-10 


0-82 


0-12 


0-09 


0-78 


Uniform 


0-20 





42 


0-00 


001 


0-44 


0-04 


0-04 


0-51 


0-04 


0-04 


0-46 


Beta(2,2) 


0-05 





13 


0-00 


0-01 


0-18 


0-02 


0-03 


0-21 


0-02 


0-03 


0-18 


Beta(3,3) 


0-04 





09 


0-00 


0-02 


0-11 


0-02 


0-03 


0-13 


0-03 


0-03 


0-11 


Beta(l,2) 


0-30 





43 


0-03 


0-22 


0-17 


0-24 


0-37 


0-18 


0-24 


0-37 


0-16 


Beta(2,3) 


0-07 





12 


0-02 


0-07 


013 


0-06 


0-11 


0-15 


0-06 


0-11 


0-13 


Cauchy 


0-87 





74 


0-82 


0-41 


0-88 


0-70 


0-37 


0-90 


0-70 


0-37 


0-89 


t(2) 


0-53 





31 


0-49 


0-29 


0-59 


0-43 


0-25 


0-61 


0-43 


0-25 


0-61 


t(3) 


0-34 





16 


0-31 


0-21 


0-40 


0-29 


0-19 


0-42 


0-29 


0-18 


0-42 


t(4) 


0-24 





10 


0-22 


0-17 


0-30 


0-21 


0-15 


0-31 


0-21 


0-15 


0-31 


t(5) 


019 





07 


0-17 


0-14 


0-24 


0-17 


0-12 


0-25 


0-17 


0-12 


0-25 


t(6) 


0-15 





06 


0-13 


0-13 


0-20 


0-14 


0-11 


0-20 


0-14 


0-11 


0-21 


Laplace 


0-26 





09 


0-22 


0-17 


0-33 


0-20 


0-14 


0-36 


0-20 


0-14 


0-35 


Logistic 


0-12 





05 


0-10 


0-10 


0-16 


0-11 


0-09 


0-16 


0-11 


0-09 


0-16 


AN(0,1)+AN(1,1) 


0-05 





05 


0-02 


0-05 


0-05 


0-05 


0-05 


0-06 


0-04 


0-05 


0-05 


iN(0,l)+|N(4,l) 


0-40 





55 


0-00 


0-02 


0-61 


0-09 


0-08 


0-58 


0-09 


0-08 


0-55 


iN(0,l)+^N(4,l) 


0-53 





27 


0-35 


0-65 


0-38 


0-53 


0-64 


0-42 


0-53 


0-64 


0-40 



tributions. Nevertheless, both tests perform quite well against those alternatives. This 
is perhaps not unexpected, since the heavy tails of those distributions will cause obser- 
vations that are so large that they dominate Yli( x i ~~ %) k completely. Such observations 
force Z' 2 to be close to either -1 or 1 and Z'^ to be close to 1. 

3.3 Concluding remarks 

In many situations of practical interest the practitioner has some idea about the type 
of non-normality that can occur; ideas about the sign of the skewness of the alternative 
and whether or not is has long or short tails. Similarly, it might be of interest to guard 
against some special class of alternatives. For instance, leptokurtic alternatives with 
k > are often considered to be a greater problem than platykurtic alternatives with 
K < 0. Judging from the simulation results presented here, the one-tailed Z' 2 and Z' 3 
tests can be recommended above some of the most common tests for normality in such 
cases. 

The good performance of the Z and Z' tests and the fact that the jackknife approach 
yields tests with essentially the same power as the "exact" tests is encouraging. Jackknif- 
ing or bootstraping to estimate correlations, or other quantities, could perhaps be used 



for other independence characterizations as well, as mentioned in lWilding Mudholkar 
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Table 3: Power of tests for normality against some alternatives, a = • 05, n = 50 



n = 50 


W 


K 


LM 




b 2 


|Z 2 | 


z 2 


z 3 


|Z 2 | 


z 2 


Z's 


x\i) 


1-00 


1 


00 


1-00 


1-00 


0-91 


1-00 


1-00 


0-92 


1-00 


1-00 


0-92 


Exponential 


1-00 


1 


00 


0-95 


1-00 


0-73 


1-00 


1-00 


0-73 


1-00 


1-00 


0-73 


X 2 (4) 


0-95 





91 


0-76 


0-95 


0-50 


0-95 


0-97 


0-48 


0-95 


0-98 


0-49 


Weib(l/2,1) 


1-00 


1 


00 


1-00 


1-00 


0-99 


1-00 


1-00 


0-99 


1-00 


1-00 


0-99 


Weib(2,l) 


0-41 





32 


0-21 


0-52 


0-12 


0-45 


0-58 


0-10 


0-46 


0-60 


0-10 


LN(<t = 1/4) 


0-44 





25 


0-34 


0-59 


0-24 


0-49 


0-61 


0-22 


0-51 


0-62 


0-23 


LN(cr = 1/2) 


0-92 





83 


0-80 


0-95 


0-60 


0-94 


0-97 


0-59 


0-94 


0-97 


0-59 


Beta(l/2,l/2) 


1-00 


1 


00 


0-03 


0-01 


1-00 


0-14 


0-10 


1-00 


0-13 


0-10 


1-00 


Uniform 


0-75 





92 


0-00 


001 


0-94 


0-04 


0-04 


0-96 


0-04 


0-04 


0-96 


Beta(2,2) 


0-15 





31 


0-00 


0-01 


0-52 


0-02 


0-02 


0-55 


0-02 


0-02 


0-55 


Beta(3,3) 


0-07 





15 


0-00 


0-01 


0-28 


0-02 


0-02 


0-30 


0-02 


0-03 


0-30 


Beta(l,2) 


0-84 





91 


0-11 


0-52 


0-31 


0-61 


0-74 


0-28 


0-63 


0-75 


0-28 


Beta(2,3) 


0-20 





29 


0-01 


0-13 


0-30 


0-12 


0-21 


0-31 


0-13 


0-23 


0-31 


Cauchy 


1-00 





99 


0-99 


0-46 


1-00 


0-82 


0-42 


1-00 


0-81 


0-42 


1-00 


t(2) 


0-86 





68 


0-87 


0-38 


0-90 


0-58 


0-32 


0-92 


0-58 


0-32 


0-92 


t(3) 


0-64 





37 


0-67 


0-30 


0-73 


0-41 


0-24 


0-75 


0-41 


0-25 


0-74 


t(4) 


0-47 





21 


0-50 


0-24 


0-57 


0-30 


0-19 


0-59 


0-31 


0-19 


0-59 


t(5) 


0-36 





13 


0-39 


0-20 


0-46 


0-24 


0-16 


0-47 


0-24 


0-16 


0-47 


t(6) 


0-28 





10 


0-32 


0-17 


0-38 


019 


0-14 


0-39 


0-20 


0-14 


0-39 


Laplace 


0-52 





26 


0-51 


0-22 


0-61 


0-24 


0-16 


0-67 


0-25 


0-17 


0-66 


Logistic 


0-20 





06 


0-22 


0-14 


0-28 


0-14 


0-11 


0-29 


0-13 


0-11 


0-29 


AN(0,1)+AN(1,1) 


0-05 





05 


0-03 


0-05 


0-06 


0-04 


0-04 


0-06 


0-04 


0-05 


0-06 


iN(0,l)+|N(4,l) 


0-90 





92 


0-00 


0-01 


0-96 


0-09 


0-07 


0-94 


0-08 


0-08 


0-94 


iN(0,l)+^N(4,l) 


0-91 





72 


0-87 


0-95 


0-65 


0-90 


0-94 


0-74 


0-89 


0-94 


0-73 



(120071 ). iBrown et all (|2004l ) studied some sub- and resampling based tests based on in- 
dependence characterizations and noted that the bootstrap and jackknife tests seemed 
to complement each other. 
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